Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

webui: add support for jsonl/ndjson file diffing as text files #8136

Merged
merged 1 commit into from
Oct 2, 2024

Conversation

kujenga
Copy link
Contributor

@kujenga kujenga commented Sep 7, 2024

Change Description

Closes #8094

This change follows the approach taken for other similar formats, allowing newline-delimited JSON files to be viewed and diffed in the LakeFS UI.

Background

Share context and relevant information for the PR: offline discussions, considerations, design decisions etc.

newline-delimited JSON is a useful format for human-readable representation of data. The goal of this change is to allow is to be viewed and diffed in the LakeFS UI.

First discussed in Slack here: https://lakefs.slack.com/archives/C016726JLJW/p1724354587851009

New Feature

If this PR introduces a new feature, describe it here.

Testing Details

How were the changes tested?

I ran make build-docker locally along with:

docker run --rm \
  --name lakefs \
  -e LAKEFS_DATABASE_TYPE="local" \
  -e LAKEFS_AUTH_ENCRYPT_SECRET_KEY="abc123" \
  -e LAKEFS_BLOCKSTORE_TYPE="local" \
  -p 8000:8000 \
  treeverse/lakefs:dev run

Then uploaded a basic JSONL file to a repo, as well as a modified version of it that adds a lineL

Screenshot 2024-09-06 at 18 26 03

Breaking Change?

Does this change break any existing functionality? (API, CLI, Clients)

Nope!

Additional info

Logs, outputs, screenshots of changes if applicable (CLI / GUI changes)

lmk if relevant.

Contact Details

How can we get in touch with you if we need more info? (ex. email@example.com)

Happy to respond in this issue or the Slack thread!

This change follows the approach taken for other similar formats, allowing
newline-delimited JSON files to be viewed and diffed in the LakeFS UI.

Closes treeverse#8094
@CLAassistant
Copy link

CLAassistant commented Sep 7, 2024

CLA assistant check
All committers have signed the CLA.

@kesarwam kesarwam requested a review from itaiad200 September 13, 2024 17:48
Copy link
Contributor

@itaiad200 itaiad200 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Checked locally, looks great! Thanks for your contribution @kujenga

Running tests and merging

@itaiad200 itaiad200 added the include-changelog PR description should be included in next release changelog label Sep 16, 2024
@kujenga
Copy link
Contributor Author

kujenga commented Oct 1, 2024

Hi @itaiad200, what's left to get this merged in?

@itaiad200
Copy link
Contributor

Forcing this merge since contributors' PRs by default do not run all required status checks. I ran them offline and they passed.

@itaiad200 itaiad200 merged commit aecc37a into treeverse:master Oct 2, 2024
39 of 41 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
include-changelog PR description should be included in next release changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support for JSONL/NDJSON file formats in the object viewer
3 participants